Context reinstatement requires a schema relevant virtual environment to benefit object recall.

How does our environment impact what we will later remember? Early work in real-world environments suggested that having matching encoding/retrieval contexts improves memory. However, some laboratory-based studies have not replicated this advantageous context-dependent memory effect. Using virtual reality methods, we find support for context-dependent memory effects and examine an influence of memory schema and dynamic environments. Participants (N = 240) remembered more objects when in the same virtual environment (context) as during encoding. This traded-off with falsely "recognizing" more similar lures. Experimentally manipulating the virtual objects and environments revealed that a congruent object/environment schema aids recall (but not recognition), though a dynamic background does not. These findings further our understanding of when and how context affects our memory through a naturalistic approach to studying such effects.

Representations within the Intraparietal Sulcus Distinguish Numerical Tasks and Formats.

How does our brain understand the number five when it is written as an Arabic numeral, and when presented as five fingers held up? Four facets have been implicated in adult numerical processing: semantic, visual, manual, and phonological/verbal. Here, we ask how the brain represents each, using a combination of tasks and stimuli. We collected fMRI data from adult participants while they completed our novel "four number code" paradigm. In this paradigm, participants viewed one of two stimulus types to tap into the visual and manual number codes, respectively. Concurrently, they completed one of two tasks to tap into the semantic and phonological/verbal number codes, respectively. Classification analyses revealed that neural codes representing distinctions between the number comparison and phonological tasks were generalizable across format (e.g., Arabic numerals to hands) within intraparietal sulcus (IPS), angular gyrus, and precentral gyrus. Neural codes representing distinctions between formats were generalizable across tasks within visual areas such as fusiform gyrus and calcarine sulcus, as well as within IPS. Our results identify the neural facets of numerical processing within a single paradigm and suggest that IPS is sensitive to distinctions between semantic and phonological/verbal, as well as visual and manual, facets of number representations.

Image memorability is predicted by discriminability and similarity in different stages of a convolutional neural network.

The features of an image can be represented at multiple levels-from its low-level visual properties to high-level meaning. What drives some images to be memorable while others are forgettable? We address this question across two behavioral experiments. In the first, different layers of a convolutional neural network (CNN), which represent progressively higher levels of features, were used to select the images that would be shown to 100 participants through a form of prospective assignment. Here, the discriminability/similarity of an image with others, according to different CNN layers dictated the images presented to different groups, who made a simple indoor versus outdoor judgment for each scene. We found that participants remember more scene images that were selected based on their low-level discriminability or high-level similarity. A second experiment replicated these results in an independent sample of 50 participants, with a different order of postencoding tasks. Together, these experiments provide evidence that both discriminability and similarity, at different visual levels, predict image memorability.

Influences on memory for naturalistic visual episodes: sleep, familiarity, and traits differentially affect forms of recall.

The memories we form are composed of information that we extract from multifaceted episodes. Static stimuli and paired associations have proven invaluable stimuli for understanding memory, but real-life events feature spatial and temporal dimensions that help form new retrieval paths. We ask how the ability to recall semantic, temporal, and spatial aspects (the "what, when, and where") of naturalistic episodes is affected by three influences-prior familiarity, postencoding sleep, and individual differences-by testing their influence on three forms of recall: cued recall, free recall, and the extent that recalled details are recombined for a novel prompt. Naturalistic videos of events with rare animals were presented to 115 participants, randomly assigned to receive a 12- or 24-h delay with sleep and/or wakefulness. Participants' immediate and delayed recall was tested and coded by its spatial, temporal, and semantic content. We find that prior familiarity with items featured in events improved cued recall, but not free recall, particularly for temporal and spatial details. In contrast, postencoding sleep, relative to wakefulness, improved free recall, but not cued recall, of all forms of content. Finally, individuals with higher trait scores in the Survey of Autobiographical Memory spontaneously incorporated more spatial details during free recall, and more event details (at a trend level) in a novel recombination recall task. These findings show that prior familiarity, postencoding sleep, and memory traits can each enhance a different form of recall. More broadly, this work highlights that recall is heterogeneous in response to different influences on memory.

Neural Patterns are More Similar across Individuals during Successful Memory Encoding than during Failed Memory Encoding.

After experiencing the same episode, some people can recall certain details about it, whereas others cannot. We investigate how common (intersubject) neural patterns during memory encoding influence whether an episode will be subsequently remembered, and how divergence from a common organization is associated with encoding failure. Using functional magnetic resonance imaging with intersubject multivariate analyses, we measured brain activity as people viewed episodes within wildlife videos and then assessed their memory for these episodes. During encoding, greater neural similarity was observed between the people who later remembered an episode (compared with those who did not) within the regions of the declarative memory network (hippocampus, posterior medial cortex [PMC], and dorsal Default Mode Network [dDMN]). The intersubject similarity of the PMC and dDMN was episode-specific. Hippocampal encoding patterns were also more similar between subjects for memory success that was defined after one day, compared with immediately after retrieval. The neural encoding patterns were sufficiently robust and generalizable to train machine learning classifiers to predict future recall success in held-out subjects, and a subset of decodable regions formed a network of shared classifier predictions of subsequent memory success. This work suggests that common neural patterns reflect successful, rather than unsuccessful, encoding across individuals.

Semantic knowledge influences whether novel episodic associations are represented symmetrically or asymmetrically.

We provide new evidence concerning two opposing views of episodic associations: The independent-association hypothesis posits that associations are unidirectional and separately modifiable links (A→B and A←B); in contrast, the associative-symmetry hypothesis proposes that a single, bidirectional association exists between A and B (A↔B). We used a novel method to demonstrate that whether or not episodic associations are symmetric depends on whether there is a preexisting semantic relationship between A and B. In two experiments, participants studied 30 semantically unrelated and 30 semantically related pairs intermixed in a single list and then performed a series of up to eight cued-recall test cycles. All pairs were tested in each cycle, and the testing direction (A-? or B-?) alternated between cycles. Unrelated pairs exhibited associative symmetry-that is, accuracy and response times improved gradually on each test-suggesting that testing in both directions strengthened the same association. In contrast, semantically related pairs exhibited a stair-like pattern, in which performance did not change from odd to even tests when the test direction changed; it only improved between tests in the same direction. We concluded that episodic associations can have either a single bidirectional representation or separate directional representations, depending on the semantic relatedness of their constituent items.

Creatures great and small: Real-world size of animals predicts visual cortex representations beyond taxonomic category.

Human occipitotemporal cortex contains neural representations for a variety of perceptual and conceptual features. We report a study examining neural representations of real-world size along the visual ventral stream, while carefully accounting for taxonomic categories that typically co-vary with size. We recorded brain activity during a functional Magnetic Resonance Imaging (fMRI) scan from eighteen participants as they were presented with images of twelve animal species. The animals were selected to vary on a number of dimensions, including taxonomic group, real-world size and prior familiarity. We apply multivariate analysis methods, including representational similarity analysis (RSA) and machine learning classifiers, to probe the distributed patterns of neural activity evoked by these presentations. We find that the real-world size of visually presented animate items is represented in posterior, but not anterior, regions of the ventral stream. A significant linear relationship is present for real-world size representation along the ventral stream. These representations remain after controlling for factors such as taxonomic category, familiarity and models of visual similarity, and even after restricting examinations to within-taxonomic category comparisons, suggesting that size information is found for within, as well as between, taxonomic categories. These findings are consistent with real-world size having an influence on activity patterns in early regions of the visual system.

Variation across individuals and items determine learning outcomes from fast mapping.

An approach to learning words known as "fast mapping" has been linked to unique neurobiological and behavioral markers in adult humans, including rapid lexical integration. However, the mechanisms supporting fast mapping are still not known. In this study, we sought to help change this by examining factors that modulate learning outcomes. In 90 subjects, we systematically manipulated the typicality of the items used to support fast mapping (foils), and quantified learners' inclination to employ semantic, episodic, and spatial memory through the Survey of Autobiographical Memory (SAM). We asked how these factors affect lexical competition and recognition performance, and then asked how foil typicality and lexical competition are related in an independent dataset. We find that both the typicality of fast mapping foils, and individual differences in how different memory systems are employed, influence lexical competition effects after fast mapping, but not after other learning approaches. Specifically, learning a word through fast mapping with an atypical foil led to lexical competition, while a typical foil led to lexical facilitation. This effect was particularly evident in individuals with a strong tendency to employ semantic memory. We further replicated the relationship between continuous foil atypicality and lexical competition in an independent dataset. These findings suggest that semantic properties of the foils that support fast mapping can influence the degree and nature of subsequent lexical integration. Further, the effects of foils differ based on an individual's tendency to draw-on the semantic memory system.